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© A technique for integrating voxelly-assigned in- 
formation regarding a portion of anatomy derived 
from a number of sources into an accurate, single 
two dimensional pixel-based representation of a view 
of that anatomy is disclosed. Empirical relationships 
between known properties are used to infer values 
for unknown properties. 
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Background of the Invention 

This invention is directed to the problem of 
providing images of anatomy that reflect at least 
one physical property of interest characteristic of 
the anatomy. It is also directed to the problem of 
inferring information regarding an unknown prop- 
erty of an interior region of anatomy from known 
properties of that and adjacent regions. 

Clinicians have long sought ways of visualizing 
interior portions of the human body without having 
to expose those portions to light for direct visual 
inspection. The first technology which enabled the 
clinician to see an image of an interior portion of 
anatomy was the X-ray, which was utilized to form 
images of bone within months of the discovery of 
X-rays by Roentgen in 1895. 

These images were essentially 2-dimensional 
views taken of a three dimensional volume of 
space. Of course, anatomy exists in three dimen- 
sional space and, in the 1970's, devices were de- 
veloped that permitted the acquisition of informa- 
tion concerning the anatomy on a three dimen- 
sional basis (e.g., the work of Hounsfield in devel- 
oping scanners that measured the density of an 
anatomical volume, which he displayed as slices). 

Subsequent developments have further ad- 
vanced the state of the art to where the clinician 
has at his disposal a variety of tools for obtaining 
information regarding each volumetric element 
within a volume of anatomy. In each of these 
techniques, the region of anatomy in question may 
be thought of as consisting of a very large number 
of small elemental units of volume called voxels. A 
voxel has length, width, and depth. The size of a 
voxel is generally limited by the inherent resolution 
of the scanner apparatus and technique utilized, as 
well as the underlying computational power with 
which the technique is practiced. Ideally, a voxel is 
small enough to depict an area of generally uniform 
attributes with respect to a property of interest. 

A number of imaging techniques using a vari- 
ety of types of imaging apparatus subdivide a 
volume of space into voxels. For example, in Mag- 
netic Resonance Imaging (MRI), a "slice" of a 
patient's anatomy, or the like, having a finite thick- 
ness is excited with a predetermined pulsing sig- 
nal. This pulsing signal causes protons (e.g., Hy- 
drogen protons) in the slice to resonate giving off a 
signal, the intensity of which varies directly with 
proton density. Different properties can be the fo- 
cus of the scan by varying the excitation energy, 
relaxation time parameters etc. employed in the 
scan, as well as by using any or none of a variety 
of chemical imaging agents. Whichever technique 
is employed, it results in the measurement of a 
property of the matter contained within each voxel. 
Such measurements are converted into electrical 



signals of varying intensity across the slice (which 
is as little as one voxel thick) and stored in a data 
base. Each measured intensity actually represents 
a value of the property of interest accessed by the 

5 scanner technique for a finite volumetric space in 
the patient's anatomy, i.e., voxel. A complete un- 
derstanding of MRI is beyond the scope of this 
application. A more intensive discussion of MRI 
can be found in "The MRI Manual" by Robert B. 

to Lufkin, published by Year Book Medical Publishers, 
1990, the disclosure of which is hereby incorpo- 
rated by reference in its entirety. 

Another medical imaging technique is Com- 
puted Tomography. In CT, X-rays impinge upon a 

rs slice of a patient's anatomy, for example. Once this 
electromagnetic radiation has passed through the 
anatomy, its intensity is measure and stored. Gen- 
erally, the X-ray source is rotated around the pa- 
tient's anatomy, and measurements of electromag- 

20 netic intensity are taken for each different position 
of the X-ray source. The resulting data is pro- 
cessed in a computer to determine a intensity 
value for each voxel in the anatomical slice. This 
intensity value is proportional to the physical prop- 

25 erty CT scanners are constructed to sense - the 
proton density of matter located within the voxel. A 
complete understanding of CT is beyond the scope 
of this application. A more intensive discussion of 
CT imaging can be found in "Principles of Radiog- 

30 raphic Imaging - An Art and a Science" by Richard 
R. Carlton and Arlene M. Adler, published by Del- 
mar Publishing (1992), the disclosure of which is 
hereby incorporated by reference in its entirety. 
While the concept of a voxel is useful in or- 

35 ganizing and processing data, it is not the form in 
which information is presented to the clinician, no 
matter what the scanning technique employed. Be- 
cause of limitations in display technology as well 
as the manner in which humans desire to view 

40 information, data is presented to clinicians in terms 
of two-dimensional renderings, either on a video 
screen or on a hard copy, such as a photograph. 
The elemental units into which a two dimensional 
image are presented are known as pixels. 

45 In producing an MRI image, the measured sig- 
nal intensities for each voxel are converted into a 
value related to a display device. For example, if 
the measured intensities are to be displayed on an 
8-bit/pixel gray-scale monitor, each measured in- 

so tensity for each voxel in the displayed slice would 
be converted into a value between 0 and 255 (i.e., 
0 to {2 s - 1}). Depending on the measured inten- 
sities, an image, which is the display of the con- 
stituent pixels, is generated, with one pixel being 

55 defined for each voxel in the slice. In the ag- 
gregate, these pixels visually portray the structure 
contained within the slice in terms of the properties 
detected by the imager in a manner which results 
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in an image that can be interpreted by trained 
personnel. 

Similarly, in formulating a CT image for dis- 
play, the intensity values corresponding to a mea- 
sured property - proton density - for each voxel in 
the slice must be scaled to a monochromatic grey 
scale for defining the pixels that actually form the 
image on the display device. In a CT image, one 
observes a higher level of definition of bone matter 
as compared to an MRI image. This is due to 
higher density of the bone matter which corre- 
sponds to a higher value in the grey scale for the 
CT image (i.e., pure white represents the highest 
value on the grey scale). Once again, these pixels 
visually portray the structure contained within the 
slice in terms of the properties detected by the 
imager in a manner which results in an image that 
can be interpreted by trained personnel. 

Within the individual scanning techniques that 
have been developed, efforts have been made to 
enhance the information presented to the clinician. 
For example, a number of methods have been 
utilized for differentiating between different types of 
matter in a medical image. For instance, in U.S. 
Patent No. 4,835,712 to Drebin et al., each voxel is 
classified as to percentages of different materials 
(i.e., air, fat, bone, and soft tissue). A color is 
assigned to each material (e.g., white for bone, 
green for fat, etc.) which is used to generate the 
appearance of each voxel. 

In U.S. Patent No. 5,185,809 to Kennedy et al. 
an apparatus is described for outlining different 
portions of the medical image depending on tissue 
type. Such outlining allows the user to discern 
between different matter types in the image. 

In U.S. Patent No. 4,991,092 to Greensite, an 
image processor is described for enhancing con- 
trast between subregions of a region of interest. 
Biological tissue of different types are each as- 
signed a different color depending on their NMR 
characteristics for better contrast. 

U.S. Patent No. 4,945,478 to Merickel et al. 
pertains to an imaging system for displaying an 
image of the aorta. MRI derived data (e.g., T t - 
weighted, T 2 - weighted) of the patient are used to 
discern different tissue types (esp. plaque constitu- 
ent tissue) in the aorta. Once the tissue type is 
discerned, those pixels representing each tissue 
type are given a uniform color. 

U.S. Patent No. 5,187,658 to Cline et al. de- 
scribes a system for segmenting internal structures 
contained within the interior region of a solid ob- 
ject. 

U.S. Patent No. 5,224,175 to Gouge et al. de- 
scribes a method for analyzing ultrasound images. 
Values from the ultrasound image are compared to 
values for known tissues in order to identify tissue 
type. 



U.S. 3.903.414 to Herbstein et al. simply de- 
scribes a system that combines X-ray diffraction, 
fluorescence, and absorption. 

The disclosure of the foregoing references are 
s hereby incorporated by reference in their entirety. 
In general, the techniques taught therein calls for 
manipulating the data provided by a single type of 
scanner. The resulting image may be more pleas- 
ing to the eye or even have some additional func- 

70 tionality, but it still inevitably incorporates which- 
ever uncertainties characterize the underlying scan- 
ning modality in question. Each individual scanning 
technique is limited to providing a visual repre- 
sentation of a physical property of the material that 

75 the imager measures. Unfortunately, that physical 
property may not correspond to what the clinician 
really wants to directly measure, or it may contain 
inherent levels of uncertainty that the clinician may 
wish to reduce. This problem is more clearly un- 

20 derstood when considering the special case of the 
property that clinicians most clearly want to ac- 
cess: the visual appearance of tissue in light. 

The clinician is most interested in viewing a 
hidden, interior region of anatomy without having to 

25 expose it by surgery, or, if he is to operate anyway, 
he wishes to see what surgery will reveal before 
the patient is cut open, so that he may better plan 
his surgical approach. In addition, he would like to 
see adjacent regions beyond what surgery will ex- 

30 pose. Therefore, what is ideally required is a scan 
that shows the surgeon what his eyes would see, 
including the proper choice of color for each type 
of matter (i.e., tissue) viewed. In brain surgery, the 
number of visually distinct types of anatomy, i.e. 

35 differentiate by color and appearance, that the 
surgeon sees is small in number (although, were 
one to take the non-visible ways in which one could 
characterize tissue into account, such as by func- 
tion or electrical activity, there would be potentially 

40 many more "types" of anatomy). There are per- 
haps ten or so such types of tissue that are visible 
and distinguishable to the unaided eye of the sur- 
geon (e.g., bone, white matter, grey matter, venous 
tissue, etc.) and which are visibly characterized by 

45 a unique appearance and color (i.e., the appear- 
ance of each type of tissue is its "property"). 
Unfortunately, none of the existing scanning tech- 
niques can present an image that corresponds to 
what the clinician would actually see, because of 

so the aforementioned limitations in each scanner type 
with regard to the information they can acquire. For 
example, a CAT scan simply does not do a very 
good job of detecting and differentiating among the 
various types of soft tissue present, but does do an 

55 excellent job of showing bone. Similarly, an MRI 
scan (which can be varied through the selection of 
various parameters and contrast agents) is better at 
differentiating among the various types of soft tis- 
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sue present, but does not accurately scan bone. 
Other forms of scanning or imaging a portion of 
anatomy also are deficient in the range of physical 
properties that they can access. Because of the 
limitations inherent in the known types of scans 
and the tissue-specificity of their optimal uses, 
even colorization of pixels derived from these 
scans cannot show a true image of a section of 
anatomy, because the individual scans are simply 
unable to differentiate among all the various types 
of tissue that the clinician sees. 

. There remains a need for an imaging technique 
that can take advantage of the comparative advan- 
tages possessed by the various imaging tech- 
niques in imaging particular types of tissue so as to 
form a composite image based on the information 
most accurately perceived by each of the imaging 
techniques. 

There remains a need for an imaging technique 
that can more accurately form inferences regarding 
a property not readily accessible from any one 
scanning technique (such as visible appearance) 
by utilizing information provided by several scan- 
ning techniques concerning properties that are 
more readily accessible. 

Summary of the Invention 

This invention presents a new manner of in- 
tegrating voxelly-assigned information derived from 
a number of sources into an accurate representa- 
tion of the region of interest. The method creates a 
data set that can be used to generate visual depic- 
tions of the region of interest. Typically, the clini- 
cian will prefer that this visual representation depict 
what he would see were he to directly look at the 
corresponding two dimensional surface of anatomy 
with his eyes in ordinary light. This representation 
may take the form of a two dimensional pixel- 
based display, or a three dimensional view (as via 
a holographic display). More broadly, the method 
enables one to draw inferences regarding a prop- 
erty of a hidden region of matter that is not directly 
accessible by utilizing information concerning other 
properties that are more readily accessible. 

Considering the voxel as a volume of anatomy, 
one can attribute a number of properties to each 
voxels. These properties include, and of course are 
not limited to, density (as via a CT scan), sound 
transmission characteristics, electrical activity, tem- 
perature, true appearance under visible light, en- 
ergy usage, manner of incorporating a radioactive 
isotope (via PET), various MRI-based parameters 
(such as tl and t2 among others), as well as any 
other parameter detectable by a scanner or other 
device that provides location specific information. 
Some of the aforementioned properties (such as 
density) are directly ascertainable for at least some 



types of tissue using known scanning techniques 
(e.g., CT). But others, such as the true visual 
appearance for each of the approximately ten types 
of tissue of interest to a neurosurgeon, may not be 

5 directly accessible with any one scan, or may 
require several scans to ascertain. 

According to one aspect of this invention, one 
first empirically determines the relationship be- 
tween each one of the ten or so visually distinct 

to types of matter and each of the directly accessible 
scannable properties by applying standard statisti- 
cal methods to the image data collected in a con- 
trolled, well defined series of observations. This 
information can then be used to determine which 

75 combination of measures of properties, chiefly de- 
rived from various scan modalities, sufficiently de- 
fine with the requisite degree of specificity each of 
the ten known types of tissue by appearance (the 
properties in question here). 

20 More broadly, information concerning known, 
measurable properties can be used to form an 
inference regarding the value of another, perhaps 
inaccessible, physical property of a voxel. The 
true-color appearance of a section of anatomy is 

25 but one example of a property that is not directly 
accessible to the clinician surgically exposing the 
area in question. This information is then stored in 
a series of look-up tables contained within a com- 
puters memory. 

30 Once the necessary correlations between scan- 
nable properties and the true visual image (i.e., 
property) of a tissue type (or other discernable 
surface or volumetric element of a region of inter- 
est) is obtained, it becomes possible to generate 

35 pixels to provide two dimensional views of a portion 
of anatomy that can be color coded to provide true 
color fidelity of the area in question. The clinician 
would get an image showing just what he would 
see upon surgically exposing the area in question 

40 to his eyes and to the light. 

This is done as follows. The clinician deter- 
mines which area of the anatomy (e.g., the brain) 
he wishes to obtain a color - true view of. If it is the 
brain, he and the computer know that there are 

45 only ten or so types of visually distinctive types of 
matter present. The computer then searches its 
memory, and tells the clinician which types of 
scans are necessary in order to provide the data 
necessary to provide the color-true image. The 

so scans required must provide registration of image 
space to physical space within each scan, as well 
as of image space onto image space across scans. 
One way of accomplishing this is through the use 
of image markers, the use of which is described in 

55 U.S. Patent No. 4,991,579 (the contents of which 
are incorporated herein by reference); another, less 
preferred method is through the use of a stereotac- 
tic frame, rf the necessary scans have already 
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been taken, then the information generated by 
these scans are loaded into memory. The com- 
puter, armed with the empirically derived relation- 
ships previously established between the various 
parameters the clinician can remotely access via 
the scans and the various tissue types by their true 
visual appearance, selectively culls the addresses 
of those voxels in the plane in question corre- 
sponding to each of the ten tissue types by ap- 
pearance, one after the other. (Of course. If a 
lesser degree of color fidelity is desired by the 
clinician, fewer tissue types may be needed or 
fewer scans may be required.) By considering the 
voxels in planes, The address of each voxel of 
interest can define a pixel address on the forming 
image. For example, the addresses of voxels lying 
along a plane can be used to define a group of 
pixels that will form a plane image. Then, the 
computer assigns a color to each pixel on the basis 
of the tissue type, as a second table within the 
computer defines the true color corresponding to 
each of the specific tissue types that have been 
assigned to each voxel. Once this has been done, 
the computer generates an image on a screen or 
on paper in which each pixel is defined within the 
computer to depict one of the ten known tissue 
types, and which has been assigned a color for 
display that matches the actual color of the known 
corresponding tissue type. 

The invention is not limited to providing views 
that correspond to what a surgeon sees, but could 
be extended to providing graphical representations 
of any anatomical or physiological feature by rely- 
ing on empirically established relationships be- 
tween the feature or property one wishes to depict 
and the data that one can obtain via various imag- 
ing techniques. 

Brief Description of the Drawings 

Fig. 1 is a flow chart of the method of the 
present invention; and 

Fig. 2 is a block diagram of a system for im- 
plementing the method of the present invention. 

Detailed Description 

The method of the invention shall be further 
explained by reference to the task of providing a 
true color image of the human head. 

The clinician first determines which areas of 
the head he wishes to image, and which particular 
types of tissue present he wishes to see. Typically, 
the physician would be interested in obtaining an 
image that showed only those portions of the head 
of the greatest interest for a particular diagnosis. In 
this example, to evaluate the brain for certain 
symptoms, the physician may decide that he re- 



quires a view of the following tissues for forming a 
diagnosis: skull, veins, arteries, brain tissue includ- 
ing grey matter and white matter, a tumor, ventri- 
cles and optic nerves. Tnis information is entered 

5 via a user interface 50 to a computer 55, where it is 
stored in a table 52 called the Designated Property 
Table. This table contains a sub-table 53 that cor- 
relates the type or types of scans which should be 
performed to best provide information for forming 

to an image of each type of tissue the clinician has 
designated. A list of these scans, along with scan- 
specific parameters required (e.g., the use of 
Gadolinium for an MRI scan) is then displayed to 
the clinician via the interface 50. The patient is then 

75 subjected to the computer specified scans. 

The computer then determines the particular 
scans that are most appropriate for characterizing 
each designated type of tissue. This is determined 
chiefly through prior empirical study. With respect 

20 to the example presented above, it is known that 
bone or skull can best be seen with a CT scan un- 
enhanced; the veins and arteries can be seen best 
with a Venous MR! Angiogram and Arterial MRI 
Angiogram, respectively; the white matter of the 

25 brain can be seen more clearly with a T-1 MRI 
Scan; the grey matter can be seen best with a T-2 
MRI Scan; if there is interest in the optic nerves, 
these can be seen with a T-1 MRI Scan. If there is 
interest in locating a specific tumor, such as a 

30 meningioma, this can best be seen with a T-2 MRI 
scan with Gadolinium; and for ventricles, this can 
best be seen again with a T-1 MRI Scan. Further- 
more, it can be empirically determined with respect 
to each physical property measured by the afore- 

35 mentioned scan which range of values of that prop- 
erty correlate with any particular feature. For exam- 
ple, a correlation can be drawn between the mag- 
nitude of the Hounsfield numbers generated in a 
CT scan with the probability that the voxel asso- 

40 ciated with that particular Hounsfield number con- 
tains bone. Similarly, statistical correlations can be 
empirically determined with respect to any other 
property and a measured value by empirical study. 
These relationships are stored in the Empirical 

45 Relationship Table 70. 

In each scan, the patient is provided with a 
means for establishing a fixed address for each 
volumetric element within the patient's head that is 
of interest. Preferably, this means may be a series 

so of at least three fiducial markers, as described in 
U.S. Patent No. 4,991,579 to Allen. Less preferable 
means of establishing a fixed address include the 
use of a stereotactic frame, or contour data relating 
the interior of the skull to relatively immutable 

55 features of the skull, ft is necessary that some 
means be provided to relate the data provided by 
one scan for a particular element within the head to 
data provided by other scans to that same element 
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within the head. This is particularly important where 
the patient must be physically moved from scanner 
to scanner, or when it is desired to image the 
patient in a single scanner at temporally spaced 
times. The degree to which statistical correlations 
can be used to infer information is dependent upon 
the accuracy with which these data sets can be 
mapped onto one another, and fiducial markers are 
the preferred means of providing such mapping 
accuracy. 

With each scan, a property related to each 
voxel of interest is measured and can be ex- 
pressed in terms of a voltage. The values of each 
voxel measurement are then stored in a data struc- 
ture (such as an array) within the computer or, 
more typically, on a mass-storage device. This first 
array will then contain a series of addresses cor- 
responding to each voxel; the voxels can be related 
to the patient's physical space by, for example, the 
use of fiducial markers as noted above. Associated 
with each address is a number denominative of the 
magnitude of a particular property which the scan- 
ner measures. In the example given, the values 
generated by the CT scan would be stored in the 
table or array 61. 

The process is repeated for each type of scan 
designated by the computer. Each scan produces 
its own data array or table having the same ad- 
dresses as the other scans, but containing num- 
bers reflective of the magnitude of the property that 
the scanner measures. In the example given, table 
62 contains data generated by the venous MRI 
angiogram, table 63 contains data generated by the 
Arterial MRI angiogram, table 64 contains data gen- 
erated by the T1 MRI, table 65 contains data from 
the T2 MRI, and table 66 contains data generated 
by the T2 scan with Gadolinium. There can be as 
many tables as there are sources of information. 

When the scans have been entered into mem- 
ory, the computer then returns to the Designated 
Property Table 52 and proceeds to extract the pre- 
selected property that the clinician wishes to see. 
For that property (i.e., the tissue specified), the 
computer looks up in an Empirical Relationship 
table 70 the range of values of properties obtained 
through the scans that correlate to the presence of 
that type of tissue within a desired degree of accu- 
racy. In the particular example given, the designa- 
tion of a voxel as belonging to a specific tissue 
type may require nothing more than examination of 
the value obtained from a single scan (e.g., bone 
can be determined from consideration of the Houn- 
sfield numbers of a GT scan alone). However, more 
generally, the Empirical Relationship Table 70 may 
correlate values obtained from a variety of scans in 
determining the identity of those voxels that cor- 
respond to the particular type of tissue under con- 
sideration. Once the identity of the property asso- 



ciated with a voxel is established, that information 
is stored in an Inferred Property Table 75. 

As the addresses of voxels having the first 
designated property are determined, a correspond- 
s ing pixel table 80 is created. In this table, an 
address corresponding to the voxel in question is 
given an appearance value to specify the display 
characteristic which the pixel will have in forming 
any image of the area. The color scheme is stored 

io in color table 77. Typically, in the interest of having 
the depicted region appear true to life, the bone 
would be assigned the color white; veins the color 
blue; arteries the color red; white matter of the 
brain tissue would be assigned the color cream; 

T5 the grey matter of the brain tissue the color red- 
dish-tan; the optic nerves yellow; the meningioma 
as reddish-grey; and the ventricles as pale aqua. 
Of course, other color scheme could be desig- 
nated, whether to better highlight other aspects of 

20 the anatomy or for other reasons. 

This process would be repeated for every 
property in the Designated Property Table. The 
result would be a set of addresses corresponding 
to physical locations of the brain of interest to the 

25 physician, with which is associated information 
identifying each location by tissue type and its 
corresponding color. This information, collected in 
the form of pixels, is then used to create a picture 
via display 90 of the region of interest in its true 

30 colors. 

In the above example, the goal of the clinician 
was to obtain a true-color image of a portion of 
cranial anatomy. This generally required the iden- 
tification of a small number of types of tissue. 

as However, the invention may be viewed in broader 
terms. The information obtained by a scan is by 
definition accessible. It is measured as a mag- 
nitude of a property that is generally not the prop- 
erty of actual interest to the clinician. (For example, 

40 the clinician may be interested in the distribution of 
bone or white matter within the head, but he is 
certainly much less likely to be interested in the 
distribution of protons or certain spin relaxation 
times within the head.) The "Accessible Property" 

45 then, is merely at best a surrogate of another 
property of greater interest, such as appearance, 
tissue type, etc. This latter property may be gen- 
erally thought of as a Derived Property that the 
clinician specifies as the Designated Property. 

so The addresses of those portions of matter hav- 
ing a particular Derived Property may be discer- 
nable by reference to only a single scan. This is 
true where the empirical correlation between the 
Derived Property to the Accessible Property is 

55 strong within a given range of scanned values. For 
example, when hounsfield numbers within a given 
range are encountered, the computer may imme- 
diately label the corresponding voxels as being 
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bone without reference to other information. 

But for other properties, particularly with re* 
spect to the soft tissues of the body, this one-to 
one correlation may not be present. At this point, 
the power inherent in the methods collection of 5 
information from multiple sources with respect to 
voxels having commonly defined addresses within 
each imaging modality comes to the fore. The 
technique provides a rapid method for storing in- 
formation derived from multiple sources regarding to 
matter in well defined locations. The power of the 
computer can be used to rapidly study the manner 
in which the information obtained about a voxel 
with respect to one type of scan is related to the 
values obtained for that voxel for other scanned is 
properties, since the data is handily stored in com- 
puter addressable form. Numerous standard statis- 
tical studies can be employed to study these rela- 
tionships. These known properties can thus be 
related to each other, as well as to their location in 20 
space or the values of identical or different prop- 
erties in other parts of the region of interest. These 
can further be correlated with properties that are 
either difficult or impossible to measure non-in- 
vasive ly. Invasive studies carried out in the course 25 
of other medically necessary procedure, cadaver 
studies, animal studies or any other known manner 
of gathering information regarding a region of mat- 
ter could be used to aid in the manner in which the 
various measured properties correlate to an other, 30 
unscanned, property of interest. 

In fact, the technique can be used to enable 
the mathematically rigorous study of such relation- 
ships among the scanner accessible properties. In 
essence, the technique described here permits one 35 
to infer an unknown property, which may or may 
not be accessible noninvasive^, by weighing the 
data provided by other known properties. This 
might well lead one to establish a degree of over- 
lap among the imaging modalities employed that 40 
would enable clinicians to obtain all of the informa- 
tion they require by using fewer types of scan, 
which would reduce the expense involved. 

Claims 45 

1. A method for inferring a physical property as- 
sociated with the discrete spatial locations of a 
three dimensional object, wherein each spatial 
location of the three dimensional object has a so 
unique address, and wherein the three dimen- 
sional object is composed of a plurality of 
types of matter, each type of matter having at 
least two properties, comprising the steps of: 

generating a first set of data reflective of at 55 
least one physical property accessible by a 
first imaging technique for each spatial location 
of the area of interest; 



generating a second set of data reflective 
of at least one physical property accessible by 
a second imaging technique for each spatial 
location of the area of interest; 

storing the data generated by the first and 
second imaging techniques in a memory stor- 
age device along with the address of each 
spatial location; and 

assigning to each address a first value 
based on the correlation between a property of 
Interest with the measures of the physical 
properties obtained in the imaging scans tak- 
en. 

2. The method of claim 1 , further comprising the 
step of assigning to each address a pixel dis- 
play value defining the physical appearance 
that the pixel is to have upon its display. 

3. The method of claim 2, further comprising the 
step of 

displaying an image based on the pixels 
so defined. 

4. The method of claim 1 , wherein the first set of 
data is generated by a CT scan. 

5. The method of claim 1 , wherein the first set of 
data is generated by a PET scan. 

6. The method of claim 1 , wherein the first set of 
data is generated by a particular type of MRI 
scan. 

7. The method of claim 1, further comprising the 
steps of 

generating additional sets of data reflective 
of at least one additional physical property 
accessible by additional imaging techniques 
for each spatial location of the area of interest, 
wherein each spatial location has an address; 
and 

storing the additional sets of data so gen- 
erated in a computer memory along with the 
address of each spatial location. 

a The method of claim 1, wherein the three 
dimensional object includes a portion of human 
anatomy. 

9. The method of claim 1, wherein the physical 
properties being inferred relate to the appear- 
ance of the region when exposed to visible 
light. 

10. The method of claim 1, wherein the second set 
of data is generated by a CT scan. 
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11. The method of claim 1, wherein the second set 
of data is generated by a PET scan. 

12. The method of claim 1, wherein the second set 
of data is generated by a particular type of 
MRI scan. 

13. The method of claim 1, wherein the correlation 
between the property of interest and the mea- 
sure of at least one of the physical properties 
measured in at least one of the generated data 
sets is determined empirically. 



convening the measures of said identified 
properties of each type of matter to a display 
such that the image is displayed in a fashion 
that distinguishes each type of matter iden- 
5 tified from other types of matter. 

23. The method according to Claim 22 wherein 
said 3-dimensional object includes a portion of 
the human anatomy. 

10 

24. The method according to Claim 22 wherein 
said different types of matter include tissue, 
fluid and gasses. 



14. The method of claim 1, wherein at least one of 

the generated sets of data is reflective of den- rs 

sity. 

15. The method of claim 1, wherein at least one of 
the generated sets of data is reflective of the 
position of known features in relation to each 20 
other. 

16. The method of claim 1, wherein at least one of 
the generated sets of data is reflective of the 
presence of hydrogen. 25 

17. The method of claim 1, wherein at least one of 
the generated sets of data is reflective of 
sound transmissibility. 

30 

18. The method of claim 1, wherein at least one of 
the generated sets of data is indicative of the 
manner in which light is absorbed or reflected. 

19. The method of claim 1, wherein at least one of 35 
the generated sets of data is reflective of tem- 
perature. 

20. The method of claim 1 , wherein at least one of 

the generated sets of data is reflective of elec- 40 
trical activity. 

21. The method of claim 1, wherein at least one of 
the generated sets of data is reflective of en- 
ergy usage. 45 

22. A method for generating images of a 3-dimen-' 
sional object having several different types of 
matter wherein each type of matter has prop- 
erties which distinguish it from other types of so 
matter in the same object comprising: 

assigning an address to each area of inter- 
est within the object; 

identifying properties that correspond to 
each type of matter and distinguishing them 55 
from properties of other types of matter of the 
same object; 

measuring said identified properties; and 
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